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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address « 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

• If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

I) K Responsive to communication(s) filed on 07 February 2005 . 
2a)D This action is FINAL. 2b)^ This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quay/e, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) S Claim(s) 15-25 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) 13 Claim(s) 15-25 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

I I) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1 ) I3 Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-413) 

2) □ Notice of Drattsperson's Patent Drawing Review (PTO-948) Paper No(s)/Mail Date. . 

3) □ Information Disclosure Statements) (PTO-1449 or PTO/SB/08) 5 ) D Notice of Informal Patent Application (PTO-152) 

Paper No(s)/Mail Date . 6) O Other: . 



U.S. Patent and Trademaik Office 
PTOL-326 (Rev. 1-04) 



Office Action Summary 
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1 . Applicant's correspondence filed on 7 February 2005 has been received and considered. 
Claims 15-25 are pending. Claims 1-14 have been canceled. 

2. The applicant's response acknowledged the restriction requirement and election without 
traverse. 



Priority Claims 

4. The applicant(s) has inserted the chain of priority into the specification showing priority 
(effective filing date) back to 23 June 1989. 



5. The disclosure is objected to because of the following informalities: 

The applicants supplied Appendix C on CD-ROM in PDF format as noted on page 3 of 
their Remarks (applicants' page #1 17). However, 37 CFR 1.96(c) requires such materials to be 
in an ASCII format. Related ASCII formats (i.e. - most "text" (.txt) formats, Rich Text (.RTF), 
etc.) would suffice as alternatives. However, the Examiner does not have authority to waive the 
requirements of this rule and accept non-ASCII data formats. The applicant would need to file a 
petition under 37 CFR 1 . 1 83 to request a waiver or suspension of the rules. 



Drawings 



3. 



The cancellation of figures 31-143 is accepted. 



Specification 
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Claims 



6. Claim 21 is rejected under 35 U.S.C. 1 12, first paragraph, because the specification, 
while being enabling for adding speech recognition to a computer, does not reasonably provide 
enablement for the details of a computer's operating system. The specification does not enable 
any person skilled in the art to which it pertains, or with which it is most nearly connected, to 
make and use the invention commensurate in scope with these claims. 

The "event queue" in particular is not shown in any drawing nor are any details in the 
specification provided about how the invention modifies the operating system as 
presented in claim 21 . 

7. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or 
described as set forth in section 102 of this title, if the differences between the subject 
matter sought to be patented and the prior art are such that the subject matter as a whole 
would have been obvious at the time the invention was made to a person having ordinary 
skill in the art to which said subject matter pertains. Patentability shall not be negatived 
by the manner in which the invention was made. 

8. Claims 15-19, 21-25 are rejected under 35 U.S.C. § 103 as being unpatentable over 
Hansen (4,776,016). 

As per claims 15, 17, 18, 22 and 23, Hansen teaches "a voice user interface" (see his 
adaptable control system , abstract and figures): 
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"recognizing a voiced utterance" (his voice recognition systems , col. 5, line 1 1); 
"converting said voiced utterance into a command string including a command 
simulating a mouse function" (suggested by his disclosed ability to move t he cursor on the 
display through the use of voice commands, cursor control inputs or both. The cursor control 
inputs include cursor control button, the mouse, the digitizer, etc. , col. 5, lines 26-33 - see also 
col. 6, lines 14, 42-46 and figures 1-2 - while the Hansen does not explicitly state that he is 
simulating a mouse function he does explicitly state that a user may use keys... to move the 
cursor on the computer screen . . .or, if the user desires, the user may utilize voice commands via 
the microphone 33 to perform these functions - since he also teaches the use of a mouse as an 
alternative cursor control input, it would have been obvious to utilize or substitute verbal 
commands for similar cursor control functionality). 

Claim 16: A "command string further comprises a command to said program" is 
redundant over the use of a "command" as noted under claim 15. 

Claim 19: A number of text "arguments" are shown for generating commands that 
require more than one word in figure 10 regarding programs or commands for programs 
containing multiple words. Figure 14 and col. 11, line 65-col. 12 in particular show that voice 
commands can include multiple words such as specific x and y coordinates where it is desired to 
locate the cursor . Figure 14, 4 th box (move the cursor (XD=XN-X0, YD=YN-Y0) shows the 
relative calculations for movement of the cursor that would be equivalent to the calculations 
necessary for relative movements of a mouse to perform the same function. This is taught as an 
alternative to commands such as up, down, left, right, etc. that would mimic individual keys for 
cursor control. 
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Claim 21 : It is inherent that if a command is directed to the operating system, then it will 
particularly affect an "event queue" of the operating system. Computers require an operating 
system to schedule events that that must be performed and make extensive use of queues to 
manage the order in which the operating system will send instructions to the processor (CPU). 
The applicant's specification in paragraph 48 that the claimed "event queue" is "not shown" and 
that the Macintosh computer used by the applicant has an inherently event driven operating 
system. Therefore, this is considered evidence that the applicant did not invent event driven OS 
nor an "event queue". Arguments to the contrary should include a figure disclosing details to 
make and use an event queue along with necessary explanations and evidence showing that this 
is not new matter. 

Claims 24, 25: See claim 15 above. A set of representations that allow "mapping from a 
member of said set of internal representations to a member of said set of output strings" is taught 
by Hansen as noted above in that he stores templates that have the mappings that indicate how 
each voice command will be interpreted and output (see fig. 3, boxes 44 and 46). 

9. Claims 20 are rejected under 35 U.S.C. § 103 as being unpatentable over Hansen 
(4,776,016) in view of Macintosh (Macintosh SE/30 Owner's Guide). 

It is noted that Hansen does not teach the use of "menu selection". However, this is 
explicitly taught as inherent in many computers available since 1888 as shown in the Macintosh 
reference on page 111 where the definition of menu indicates that it is inherently A list of 
commands that appears when you point to and press the menu title in the menu bar. Dragging 
through the menu and releasing the mouse button while a command is highlighted chooses that 
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command. Therefore, it would have been obvious to one of ordinary skill in the computer arts to 
use the voice control system of Hansen in a computer that has inherent menu selection 
capabilities because Macintosh teaches menu selection is an obvious combination that modern 
software will allow computers to perform if they are normally operated in combination with a 
mouse. 



10. The applicant's argument that McKiel is not prior art because of the earlier effective 
filing date based upon the chain of continuing applications is convincing. Therefore, new prior 
art showing that the claimed invention is not patentable have been applied as noted above. 



11. Some correspondence may be submitted electronically. See the Office's Internet Web 

site http://www.uspto.gov for additional information. 

Please address mail to be delivered by the United States Postal Service (USPS) as 

follows: 

Mail Stop 

Commissioner for Patents 
P.O. Box 1450 
Alexandria, VA 22313-1450 

The Central fax number is 571-273-8300. Please label INFORMAL" or "DRAFT" 
communications accordingly. 

Mail Stop should be omitted if none is indicated. 

Effective 14 January 2005, except correspondence for Maintenance Fees, Deposit 
Accounts (see 37 CFR 1.25(c)(4)), and Licensing and Review )see 37 CFR 5.1(c) and 5.2(c)), 
please address correspondence delivered by other delivery services (i.e. - Federal Express (Fed 
Ex), UPS, DHL, Laser, Action, Purolater, etc.) as follows: 



Remarks 



U.S. Patent and Trademark Office 
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Customer Window, Mail Stop 

Randolph Building 
Alexandria, VA 22314 

12. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to David D. Knepper whose telephone number is (571) 272-7607. 
The examiner can normally be reached on Monday-Thursday from 07:30 a.m.-6:00 p.m. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil, can be reached on (571) 272-7602. 

For the Group 2600 receptionist or customer service call (571) 272-2600. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Inquiries regarding the status of submissions 
relating to an application or questions on the Private PAIR systsem should be directed to the 
Electronic Business Center (EBC) at 866-217-9197 (toll-free) or 703-305-3028 between the 
hours of 6 a.m. and midnight Monday through Friday EST, or by email at ebc@uspto.gov . For 
general information about the PAIR system, see http://pair-direct.uspto. gov . 




David D. Knepper 
Primary Examiner 
Art Unit 2654 
July 14, 2005 



